It  it  BhoMn  that  Monger *8  theorem  and  the  Max  Plow 
Min  Cut  Theorem  on  networke  are  applications  of  the  duality 
theorMi  of  linear  inequality  theory*  /  ^ 
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ON  THE  MAX  PLOW  MIN  CUT  THEOREM  OF  NETWORKS 
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D.  R.  Fulkerson 

The  RAND  Corporation 

INTRODUCTION 

The  problem  discussed  in  this  paper  arises  naturally  In  the 
study  of  trsnsportetlon  networks.  Roughly  stated.  It  is  as 
.  follows*  Consider  a  network  connecting  two  nodes  by  way  of  a 
nunber  of  intemediate  nodes,  and  suppose  the  arcs  and  nodes 
can  handle  certain  designated  amounts  of  traffic  per  unit  time* 
Assuming  a  steady  state  condition,  find  a  maximal  flow  of 

e 

traffic  from  one  given  node  (the  source)  to  the  other  (the  sink)* 
For  exaiig)le,  let  the  network  be  that  of  Fig.  i 


Pig*  1  Fig.  2 

where  source  and  sink  are  denoted  by  and  —  respectively,  with 
flow  capacities  of  the  arcs  and  nodes  as  indicated.  A  maximal 
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flow  from  source  to  sink  Is  shown  In  Pig.  2.  Notice  that  the 
quantity  of  flow  leaving  the  source  (or  entering  the  sink)  Is 
equal  to  the  sum  of  the  capacities  of  the  two  nodes  and  one 
arc  which  are  emphasized  In  the  figure,  ana  that  this  collection 
of  nodes  and  arcs  forms  a  "cut”  In  the  network;  l.e.,  meets 
every  chain  from  source  to  sink. 

A  nonconatructlve  proof  based  on  convexity  arguments  has 
been  given  In  an  unpublished  manuscript  by  L.  R.  Ford,  Jr.  and 
one  of  the  present  writers  (D.  R.  Fulkerson)  that  the  maximal 
flow  value,  relative  to  a  given  source  and  sink,  attainable  In 
any  network  Is  equal  to  the  minimal  sum  of  capacities  on  arcs 
and  nodes  constituting  a  cut.  Our  aim  Is  to  formulate  the 
problem  of  finding  a  maximal  flow  as  a  linear  programming 
problem  (§1)  and  to  deduce  the  max  flow  min  cut  theorem  from 
the  dual  problem  (^3).  In  §4  we  observe  that  a  combinatorial 

form  of  this  theorem  yields  Menger's  theorem  [4,  p.244]  concerning 
linear  graphs.  , 


1.  THE  PROQRAMMINQ  PROBLEM 

There  are  various  ways  of  formulating  the  flow  problem  as 
a  linear  programming  problem.  One  wayl^  convenient  from  both 


^  different  formulation  of  the  problem  whlc 
also  yields  ^e  max  flow  min  cut  theorem.  While  the  techniques 
employed  In  his  approach  are  similar  to  those  of  this  naner  he 

uses  an  entirely  different  set  of  variables  which  are  of  Interest 
In  themselves. 


a ■  computational  and  theoretical  viewpoint,  lo  as  follows.  Set 
up  the  pseudo  transportation  ari’ay 
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schematizing  the  equations 


(la) 


(l*0,l, . . .  ,n) 


1  ^#***tn). 


where  x^j  ^  0  (l; J»l, . .  •  ,n;  1+j)  denotes  the  flow  from  node 
1  to  node  J,  >  0  (l»l,..,,n)  represents  the  total  flow 
through  node  1,  x^j  >  0  (j«l,...,n)  Is  the  flow  from  the  source 
to  node  J,  and  x^^  >  0  (l»l,,.,,n)  the  flow  fron  node  1  to  the 
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Blnk*  Thus  is  ths  total  flow  through  the  network  and  the 
problem  is  to  maximize  x^^  subject  to  (la),  (lb),  and 


(2) 

• 

*IJ  *  *J1  ^  «1J 

^®ij  "  ®ji^ 
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*11  ^  ®11 
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(^#J*G,...,n), 

mhsrs  ths  oU  are  given  nonnsgatlve  constants.  Vs  have  formally 
included  all  variables  Xj^j  In  the  problem;  arcs  not  present  In 
the  network  have  c, ,  «  0. 

ij 

Because  of  (2),  we  refer  to  this  as  the  undirected  problem; 
that  Is,  except  for  source  and  sink  arcs,  the  direction  of  flow 
is  not  specified  in  the  arcs. 

Given  an  undirected  problem,  it  is  easy  to  describe  an 
equivalent  directed  problem.  Simply  replace  each  undirected 
arc  by  a  pair  of  oppositely  directed  arcs,  each  with  capacity 
equal  to  that  of  the  original  arc.  That  the  two  problems  are 
equivalent  follows  from  the  fact  that  given  any  x  •  (x^j) 
satisfying  (l),  (3),  (4),  and 


(?•) 


^ij  i  ^ij 


^Ji  ^  ^Ji 
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a  flow  x*  of  equal  value  la  obtained  by  setting 
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Thus  (2)  may  be  replaced  by  (2*)  without  changing  the  value  of 
a  maximal  flow. 

A  out  in  an  undirected  network  has  been  defined  as  a 
collection  of  arcs  and  nodes  meeting  every  chain  joining  source 
and  sink;  a  cut  in  a  directed  network  Is  similarly  defined  as 
a  collection  of  directed  arcs  and  nodes  meeting  every  directed 
chain  from  source  to  sink.  The  value  of  a  cut  In  either  case 
is  the  sum  of  the  capacities  of  all  Its  member  nodes  and  arcs. 

One  proves  easily  that  the  minimal  cut  value  Is  the  same  for 
an  undirected  network  and  Its  equivalent  directed  network.  Thus* 
to  prove  the  max  flow  min  cut  theorem.  It  suffices  to  consider 
directed  smiNorks  only.  Accordingly,  we  shall  make  no  further 
use  of  the  condition  c^j 

Let  us  now  rewrite  the  Inequalities  (2'),  (3)> 


Cj^  In  (2*)« 


(5) 


+  (1,J  - 


where,  to  avoid  special  cases,  we  have  Included  a  sufficiently 

upper  bound  of  c  on  the  variable  ^qq»  for  example,  choose 


n 


a  >  2  c,  .  Then  the  problem  Is  to  maximise  x  subject  to 
00  10  0° 

(la),  (lb),  (4),  and  (5). 
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2 .  BASES 


We  turn  momentarily  to  the  question  of  what  constitutes 

\p 

a  basie, in  order  to  note  that  the  Hitchcock-Koopmans 
transportation  theory  carries  over  to  the  flow  problem. 

There  are  (n+l)  2(n«**l)  -  1  linearly  Independent 

equations  in  the  set  (la),  (lb),  (3),  since  one  of  the  set 
(la),  (lb),  is  redundant.  Drop  the  first  equation  of  (la) 
as  the  redundant  one,  and  denote  by  X^j,  Y^j  the  column  vectors 
of  the  coefficient  matrix  of  the  remaining  equations  corres¬ 
ponding  to  the  variables  y^^,  respectively. 

It  is  clear  that  at  least  one  of  ^ij  must  belong  to 
any  basis  B.  Thus  the  pairs  ij  fall  into  one  of  three  classes: 


dsi  those  ij 
f:  those  IJ 

those  ij 


for  which 
for  which  Xj^j 

for  which  Xj^j 


e  B,  CB; 
€B,  Yjj  <B; 

^B,  Vjj  tB. 


The  number  of  pairs  iJ  of  type  o<^ is  always  2n'«'l.  For  if  there 
are  k  of  type  hence  (n  +  1)^  -  k  of  types  ^and  JT,  then 


li 


Let 


fi 

£  a.  .X.  >  b. ,  X.  >  0  (i  ■  1, . . .  ,m)  be  the  constraints 
4^2^  J  *  J 

^  «  ft 


of  a  linear  programming  problem,  and  suppose  A  • 


rank  m. 

n 


A  set  of  m  linearly  independent  columns  of  A  is  a 
basis'*,  the  corresponding  x^  are  "basic  variables".  The 

vector  X  ■  (^•••,x^)  obtained  by  assigning  non-basic  variables 


zero  values  and  solvinx  the  resulting  equati^^ns  for  the  basic 
variables  is  called  a  ^basic  solution".  If  x  has  non-negative 
components,  it  is  termed  a  "basic  feasible  solution".  Geometri 
cally,  basic  feasible  solutions  correspond  to  extreme  points 
of  the  convex  set  defined  by  the  constraints. 
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2k  ♦  (n  1)*  -  k  •  (n  ♦  l)*  ♦  2(n  +  l)  -  1,  k  -  2n  ♦  1. 
llortov«r«  It  it  lapottible  to  find  among  tht  pairs  of  typs  a 

aubast  of  tha  form 

i^J^#  i^J2*  ^2^2*  ^2*^3'****  ^k^l 

whara  tha  i'a  and  J*a  ara  distinct  among  thamaalvaa,  as  other-' 
wiaa  tha  column  vactora  X^y  oorrasponding  to  thaaa  pairs 
can  easily  ba  shown  to  ba  dapendent. 

Thaaa  two  atatamanta  togethar  imply  that  B  can  ba  arranged 
in  triangular  form«  Just  as  in  tha  HltChcock-Koopaana  caaa. 

To  aaa  thiSi  it  is  oonvanient  to  asaociata  a  llnaar  graph  0 
with  B/and  to  look  at  the  problem  of  finding  the  basic  solution 
corresponding  to  B  in  tanaa  of  this  graph 

I<at  a^»...«a_«  b.,...,  b_  be  tha  nodes  of  0;  the  area 
of  0  ara  those  Sj^hj  for  which  ij  is  of  type  As  we  have 
aaan,  0  has  2n  1  arcs  and  contains  no  cycles.  It  is  therefore 
a  tree.  Cnll  a  node  of  0  which  has  only  one  arc  on  It  an 

a 

"end-node”  •  Thera  are  at  least  two  such . 

We  associate  with  node  a^(bj)  of  0  the  equation 

£  *4  4  •  0  (-X--  £  X. .  ■  0).  Now  locate  an  end-node, 

J,J+i  i,i+J 

There  ara  several  alternative  ways  one  can  view  the 
aquation  solving  process  in  terms  of  a  linear  graph.  Since 
the  aquations  came  from  such  a  graph,  one  way  would  be  to  use 
tha  original  network.  This  appears  to  be  most  efficient  for 
hand-oomputation.  .  Another  way,  in  terms  of  the  array  •(!), 
can  ba  developed  as  in  RfJ*  ^  third  way,  the  one  we  adont, 
is  suggested  in  [ib^ .  &  all  of  these,  the  notion  oO 

"basis"  in  the  programming  sense  is  closely  related  to  the 
notion  of  "tree^  in  the  graph  sense. 
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Bay  and  lat  its  are  be  Since  for  pairs  ij  of  type  ^ . 

y^j  •  0,  x^j  -  and  Blmllarly  -  0,  y^j  •  c^j  for  pairs 

of  type  ^  ,  all  the  variables  of  the  equation  -x.  Z  x.  .  •  0 

J,J+k 

are  determined  but  one,  x^|,  and  thus  its  value  may  be  found 

« 

immediately.  Then  use  (5)  to  get  yj^j  -  Cj^|  -  x^j.  Delete 
and  a|^b|  from  0,  leaving  a  tree,  and  repeat  the  procedure. 

After  2n  'f  steps,  the  values  of  all  variables  are  determined. 

Notice  that  only  addition  and  subtraction  are  required. 

Thus,  if  the  c^j  are  integral,  so  are  the  values  of  all  variables 
in  a  baaio  solution,  hence  in  a  basic  feasible  solution.  We 
will  make  use  of  this  fact  in  the  concluding  section. 

3>  SIMPLEX  CRITBRION  AND  THE  DUAL  PROBLEM 

^i*  '^ij  multipliers  (dual  variables) 

corresponding  to  the  equations  (la),  (lb),  (5),  respectively. 

In  applying  the  simplex  algorithm.  Then  the  conditions  for  an 
optimal  basis  B*  are: 


(6a) 

Slo 

for  1>0) 

(6b) 

c 

< 

t 

IV 

0 

(i+J) 

(6o) 

0 
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with  tquallty  holding  In  (6a),  (6b),  if  the  correapcndlng 

C  B*,  in  (6c)  If  €b*.  Ignoring  the  redundant  equation 
aaiounts  to  taking  -  0.  Then,  since  Y^^  €b*|- 
w^^  •  0,  Vq  ■  -1.  For  all  other  pairs  ij  of  type  •  0, 

and  the  equations  ^  hold.  It  follows  that  all  u^  «  0 

or  1,  all  Vj  ■  0  or  -1.  (A  convenient  way  to  see  this  is  to 
associate  the  variable  ^^^(Vj)  with  node  s^^(tj)  of  the  graph 
0#  corresponding  to  B*  and  the  equations  ^  with  the  appropriate 

arcs  of  0*).  Substituting  these  values  into  (6a),  (6b),  to 
determine  the  w^j  corresponding  to  Y^j  and  noting  (6c) 
shows  that  all  w^^  •  0  or  1. 

The  dual  programming  problem  is  to  minimise 
subject  to  (6a)  *  (6c),  and  the  multipliers  corresponding  to  an 
optimal  primal  solution  solve  the  dual  problem.  Thus 


max  •  min  £c. -w,  , 
00  ij  ij 


where  O* is  that  set  of  pairs  ij  corresponding  to  »  1;  in 
terms  of  the  network,  CTis  some  subset  of  those  (directed) 
arcs  and  nodes  which  are  at  capacity  in  the  flow  x.  We  claim 
that  CTis  a  cut.  For  suppose  all  c^j,  iJ  4  ^  increased 

by  £  >  0.  This  does  not  change  the  solution  to  the  dual,  hence 


14 

•-Our  choice  of  c  implies  that  Y  CB  for  any  B  yield¬ 
ing  a  basic  feasible  sSiution;  also  cleSrly  X  b«  except 
possibly  in  the  trivial  case  where  the  maximaS^flow  over  the 
network  is  zero.  The  assertion  is  valid  in  general,  however, 
as  otherwise  all  multipliers  have  zero  values,  violating  (6a; 
with  i  ■  0. 


J 
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cannot  increase  the  flow  In  the  network.  But  If  there  were 
some  directed  chain  from  source  to  sink  not  meeting  the 
maximal  flow  value  would  be  increased  by  at  least  C  • 

Thus<r  is  a  cut,  and  since  it  is  clear  that  no  flow  can  exceed 
the  value  of  any  cut,  the  proof  of  the  max  flow  min  cut  theorem 
is  complete. 

4.  MEWQER*S  THEOREM 

Given  an  arbitrary  linear  graph  G,  let  I^,  I2  b*  two 
disjoint  sets  of  nodes  of  G.  Menger*s  theorem  states  that  the 
maximal  number  of  pairwise  node-disjoint  chains  joining  1-^ 
to  Ig  is  equal  to  the  minimal  number  of  nodes  necessary  to 
separate  fiwalg.  To  deduce  this  theorem  from  the  max  flow 
min  cut  theorem,  join  all  the  nodes  of  1^  to  a  new  node,  the 
source,  and  all  the  nodes  of  to  another  new  node,  the  sink; 
then  assign  unit  capacity  to  each  of  the  old  nodes,  infinite 
capacity  to  each  arc.  Menger*e  theorem  now  follows  by  selecting 
a  maximal  flow  x  with  integral  components. 


I  '  ,»T-* 
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